Information Bottleneck Approach to Predictive Inference
نویسندگان
چکیده
منابع مشابه
Information Bottleneck Approach to Predictive Inference
This paper synthesizes a recent line of work on automated predictive model making inspired by Rate-Distortion theory, in particular by the Information Bottleneck method. Predictive inference is interpreted as a strategy for efficient communication. The relationship to thermodynamic efficiency is discussed. The overall aim of this paper is to explain how this information theoretic approach provi...
متن کاملAn Information Theoretic Approach for Shared Bottleneck Inference Based on End-to-end Measurements
Recent years have marked a growing interest in studying Internet performance. However, most of the currently available tools to an end system to perform such measurements are slow inaccurate and consume an excessive amount of bandwidth. This paper introduces Entropy as a novel and efficient metric for doing end-to-end Internet measurements. In particular, the paper presents an entropy-based tec...
متن کاملApplying the Information Bottleneck Approach to SRL: Learning LPAD Parameters
In this paper, we propose to apply the Information Bottleneck (IB) approach to a sub-class of Statistical Relational Learning (SRL) languages. Learning parameters in SRL dealing with domains that involve hidden variables requires the use of techniques for learning from incomplete data such as the expectation maximization (EM) algorithm. Recently, IB was shown to overcome well known problems of ...
متن کاملBayesian approach to inference of population structure
Methods of inferring the population structure, its applications in identifying disease models as well as foresighting the physical and mental situation of human beings have been finding ever-increasing importance. In this article, first, motivation and significance of studying the problem of population structure is explained. In the next section, the applications of inference of p...
متن کاملAn Information Theoretic Approach for Shared Bottleneck Inference Based on End-to-end Measurements MIT/LCS/TM-604
Recent years have marked a growing interest in studying Internet path characteristics. However, most of the currently available tools to an end system to perform such measurements are slow inaccurate and generate an excessive amount of probing traffic. This paper introduces entropy as a novel and efficient metric for discovering Internet path characteristics based on data collected by an end sy...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Entropy
سال: 2014
ISSN: 1099-4300
DOI: 10.3390/e16020968